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ABSTRACT 


Our aim in this paper is to examine a number of fundamental 
questions in the theory of optimal control of processes monitored by 
certain general systems of linear functional differential equations 
with finite memories. In our model the controls may appear in a 
very general nonlinear functional manner which permits us to consider 
retardations of a rather general character in the control variables. 
In particular ^ we prove a maximal principle for such systems. We 
consider existence questions in the class of admissible Borel 
measurable (resp, piecewise continuous,, almost piecewise continuous) 
initial functions and controls. We also show that certain solutions 
of an uncontrolled linear functional differential equation are piece- 
wise analytic or quasi piecewise analytic. 
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§1. Introduction . The linear functional differential equa- 
tion describing the controlled systems studied in this paper is- given 
in equation (2.3;) "below. Many authors have -studied control systems 
with delays in the state variables and there are several extensive 
"bibliographies available in these areas [B-5, E-l, 0-2, H-l, Z-l] . 
Recently, models for systems with delays in the control parameters 
have been proposed and some- results for these systems have "been ob- 
tained [B-3, B-U, D-l, H-3, H-ll, K-l, K-2, L-l, L-2). - Such models occur 
naturally in the study of gas -pressurized bipropellant rocket systems 
[D-l],’ in population models [B-3, L-5-], and in some complex economic . 
models currently under study. 

In section 2, we set down the notation, definitions, and 
standing hypotheses that will be required throughout. In section 3, 
we prove (see Theorem 3-1) that the collection of points in R n ,. 
which can be attained at time t from admissible Borel measurable 
initial functions and controls, is compact and depends continuously 
(with respect to the Hausdorff metric) on t. The assumptions re- 
quired for this theorem are in effect no more than is usually required 
just to prove the existence of solutions to the linear functional 



differential equation (2.3) (see [B-l, B-4]). Since the Lebesgue- 
Stieltjes measures, which will appear below in the variation bf 
parameters formula (2.7), can be atomic, we cannot conclude that the 
above mentioned fixed-time cross sections of the attainable set are 
convex. However, if we add rather mild assumptions (Properties (A^) 
and (A-,) in section 3), then we do obtain the convexity of the 
fixed-time cross sections of the attainable set (see Theorem 3=2). 

We then adapt an argument of Lee and Markus [1-3] for ordinary con- 
trol problems to obtain the statements of the maximal principle in 
section 4 (Theorem 4.1 and Remark 4.1). Theorems 3=1 and 3.2 can 
be regarded as extensions of some well known results by Neustadt 
[M-2] and Olech [0-1]. Several very special cases of these two 
theorems have appeared in the literature [C-5., L-l, L-2, 0-2] . The 
actual statement of the maximal principal is confined to the time 
optimal control problem, although this is not an essential feature 
(cf. the remarks preceding Lemma 4.1). This maximal principle 
complements recent work of Banks [B-3] and Kharatishvili [K-l, K-2], 
and in effect contains some of Lee's work [L-l, L-2] as special cases, 
although Lee has considered a somewhat different class of cost 
functionals. Also our work in essence includes the necessary con- 
ditions determined by Ihlanay in [H-2]. Even in the cases where our 
work overlaps with that of. the above authors, our methods of proof 
differ in that we have made extensive use of a number of fairly recent 
developments in the 'theory of measurable multifunctions [A-2, 

C-2, C-3, H-10, J-l, J-2, K-3, 0-1] to greatly simplify the arguments. 



In section 5 we turn to a study of analytieity properties 
of " fundamental matrix" solutions to certain systems of functional 
differential equations . Many authors (see the references in [B-5, 

E-l, Z-l]) have studied various aspects of the analytieity of the 
solutions of very special types of functional differential equations, 
although none of 'these results appear to include those presented in 
section 5- Theorem 5<>1 is a rather straightforward application of 
known results in. ordinary differential equations „ However, 

Theorem 5.2 which is extremely believable, seems to require a proof 
involving a substantially more intricate form of analysis than is 
needed to prove its simple counterpart in the theory of ordinary 
differential equations . It should be noted that the conclusion of 
Theorem 5.1 guarantees a type of piecewise analytieity of the 
11 fundamental matrix", whereas Theorem 5.2 gives only what we have 
termed quasi piecewise analytieity. One might expect that -if the 
coefficient matrices in system (5.2) are analytic, and if one -starts 
with an analytic initial function, then the solution of the functional 
differential equation will also be analytic. Indeed, several authors 
have attempted to prove such results (for example, see [0-2], [P-1]), 
but very simple examples reveal that such general theorems are not 
true (see Remark 5.1). 

Finally, in section 6 we apply the aforementioned piecewise 
analytieity (resp. quasi piecewise analytieity) properties to show 
that under certain circumstances the admissible initial functions 
and the admissible controls may be delimited to an appropriate class 
of piecewise continuous (resp. almost piecewise continuous) functions 
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functions and the attainable set will be the same as if one were 
using Borel measurable admissible initial functions and controls. 
These re stilts are simply analogs of those obtained by Halkin [H-5] 
for ordinary linear control problems using the work on sub integrals 
by Halkin and Hendricks [H-6] 0 Halkin ' s paper extends earlier work 
in [G-l, H-4, L-4 ]o 
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§2. Notation, Definitions, and General Hypotheses ,, If X 
and Y are nonempty sets, then a multifunction ft'. Y -> Y is simply 
a subset of X X 'Y with domain equal to X,* equivalently ft is a 
mapping of . X into the nonempty subsets of Y. If Y is a topo- 
logical space and ft(x) is compact for each x e X, then we say 
ft: X -» Y is a compact multifunction , If Oj is a cr^algebra of 
subsets of X and if Y is a topological space, then we say a 
multifunction ft I X — > Y is Cb -measurable if 


ft~F = .(x -e xj'ft(x) D F f JZS.) 


belongs to CL for each closed F C Y. If X is a topological 
space and C l is the collection of Borel sets in X, then we shall 

write Borel measurable instead of (X> -measurable. If (Y,d) is a 
metric space, then diam (ft{x)), x e X denotes the diameter of 
ft(x), i„e.. 


diam ft(x) = sup (d(y 1 ,y 2 )| yi,y 2 e ft(x)}. 

The real vector space of all real p X q matrices will be 

denoted by £ for any pair of positive integers p and q. It 
pq 

is assumed that a definite norm, j ° J , is given on any of the finite 
dimensional vector spaces which come into our discussion. Let 
[a,b] be a compact interval in R, and let I -» a ^ unc " 
tion of bounded variation. We shall use p to denote the 

II 

Lebesgue-Stieltjes measure on [a,b] determined by H (see [D-3, 
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pg. 358 ff.]). In constructing such measures from H, H will 
always be taken to be left continuous' on (a,b). We observe that 
•if t fft), t e [a,b] denotes the scalar ■ function defined by 


T H (t) - Tar K[a<t f(s), t e [a,!,], 

and if J denotes the variation of the Lebesgue-Stieltjes 

measure ^ then one has [D-3, Pg» 3^2 ], 


(2 = 1 ). 


I ^ P T ‘ 

il 


For conciseness we frequently -use [h| (t) for T^t) (this should 

not be confused with |H(t)| which is the norm of the matrix 

b 

H(t)). If g: '[a,b] -> R P is ^-integrable, then / g(t)dH(t) de- 

SI 


notes the integral of g over [a,b] with respect to the measure 

. We use ^([a^b], ^ R P ) to denote the collection of all 

q IT -integrable functions g° [a,b] '-»R P . 

** b 

If Si; [a,b]'-»R P is a multifunction, then / Si(t)dH(t) 
is used to denote the set (possibly empty) 


(/ g(t)dH(t) | g e ^([a,b], R P ), g(t) e 0(t), a § t § b] 

a 

(cf. [A-2, C-2,.C-3, D-2, H-7, 0-1, J-3]). 

We shall deal frequently with mappings f l X X Y -> Z where 
X,Y,Z axe sets. It will be convenient to use f(x, •), where x is 



a fixed element of X, to denote the mapping y -> f(x,y), y e Y. 

The mapping f(-,y): X -> Z, for y. a fixed element of Y is 
similarly -defined. 

Throughout the paper we make bhe following standing hy- 
potheses: 1°) F and G are two Lehesgue measurable mappings from 

RXE into 2°) F (t , s ) - 0 for s is 0, 3°) F(t,s) = 

F(t, - t) for s ^ -T where t is a given positive constant, 

4°) C-(t,s) = 0 for sit, 5°) G(t,s) = G(t,-T) for s ^ -t, 

6°) for each fixed t e S’ the functions G(t, •) and F(t, •) are 
of bounded -variation on R, and in addition 7°) there is a Lebesgue 
measurable function p: R -?R which is Lebesgue summable on every 
finite interval and which satisfies 


(2.2) |G(t,s)J, |F(t,s)| g P(t), t,s € R, 

Var seR F ^ t,S ^ = VaX se[-T,0] F ^ S ) g t 6 

Var seR G(t,s) = Var s€ ^Gfos) S p(t), t e R. 

Let h IR™" X R -> R n be a given function such that for each 

in 

t e R the function u -*h(u,t), u e R- , is continuous, and for each 
u e E m the function t -» h(u,t), t e R, is Borel measurable. We shall 
consider control systems which can be described by systems of real 
functional differential equations (FDE's) of the form 
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o z 

(2.3) x(t) = / x(i>fs)d F(t,s) + / h(u(s),s)d g G(t,s), 

- T ' -T 

where both integrals in (2.3) are understood in the Lebesgue-Stieltjes 

sense with the symbol d being used to emphasize that the measures 

s 

are constructed from the functions F(t, •) and G(t^*). 

Let UI [-t,<») R m and ,[-t, 0] -» R n be given Borel 
measurable ^ compact multi functions. It will be assumed that there 
is a positive constant M such that 

(2.4) diarn U(t), diarn h(u(t)jt) S t s _t 
diam $(t) S M, -t S t £ 0. 

A triple {cp^u^t^} is called admissible if 9: [-130] -» E. n and 
1 

' # 

u: [-T ; t, ] -» R } t^ S 0 are Borel measurable functions satisfying! 

(2.3) <p(t) e $(‘t), -t: g t g 0 } 

u(t) e U(t), -T = t = t^. 

The selection theorem of Kuratowski and Ryll-Nardzewski [K-3] assures 
the existence of admissible triples. 

Remark 2.1. It is noted that if u: [a^b] -» R m is a Borel measurable 
function^ then the function t ->h(u(t),t), t e [a^,b] is also Borel 
measurable. This follows easily from the fact that there is a 
sequence of Borel functions^ u^! [a^b] -» whose range is a 
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countable set, and which satisfy lim u (t) = u(t) for each 

n 

t e [a,b]. It follows now from the assumptions on h that t -=► 
h(.Un(t)jt)j t e [a,b] are each Borel measurable functions and 
lim h(u n (t).,t') = h(u (t),t), t e [a,b]. Consequently, 
t -»h(u(t),t), t e [a,b] is Borel measurable. 

Bor any admissible triple (cp,u, t^} there is a unique 
absolutely continuous function (or response) t ->x(t,cp,u), 

0 “ t - t^ satisfying (2.3) almost everywhere on [0,-t^] and the 
initial condition 

(2.6) x(t,cp,u) = cp (t ), -t g t g 0. 

According to the variation of parameters formula [B-l], this re- 
sponse is given by 

o T 

(2.7) x(t,cp,u) = q>(o)Y(0,t) + /cp(s)d {/ F(a,s-a)Y(a,t)do:} 

-T 3 O 

t a 

+ I (f h(u(s),s)d G(a,s)}Y(a,t)da, 

o -T 3 

where for fixed t l 0 the function s -*Y(s,t), 0 g s g t is an 
n x n matrix solution of 

t 

(2.8) Y(s,t) + / F(a, s-o:)Y(Q:,t)da = E, 0 g s g t, 

s 

which is of bounded variation and which satisfies Y(t,t) = E, the 
■n X n identity matrix, and Y(s,t) = 0 for s > t. 
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A point x'e R n is attainable if there is an admissible 
triple {cpjUjt^} such that x^^cpjU) = x. The attainable set 
Si/(fPj1jy (or simply S$f when $ and U axe understood) is defined 
by the equation 

SZf(&, U) = (x e R n |x is attainable}. 

The fixed time cross sections of U) at t ^ 0 are denoted by 

(or simply by stf. when $ and U are understood) and 
are defined by the equation 

_Q^.($>U) = {x e R n | there exist {cp,u,t} admissible 

such that x(t,<p,u) = x) . 
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§5 . Properties of the Attainable - Set wit hout Convexity 
Assumptions . We "begin with some simple lemmas and observations. 

Lemma 5.1 . Let the standing hypotheses of section 2 he satisfied. 

t 

Then |Y(s,t)| g (e| exp / p(|)d|, 0 ^ s S t. 

s 

Proof . This is an easy consequence of (2.8) and the boundary con- 
ditions . 

Remark 3..JL. If / is a compact interval and H’ -4 £ is of 
PI 

bounded variation, then H has the well known decomposition into a 
sum of a singular function, an. absolutely continuous function, and 
a saltus (jump) function. We note also that if H = A + N where A 
is the saltus function and N is continuous, then Var H = Var A + 
Var N. It is also observed that if H is continuous, then t -> 
Tjj(t), t e J? is also continuous. Consequently from (2.1) it can 
be -shown that I uj is nonatomic whenever H is continuous, 

xi 

The next lemma is in essence contained in the papers of 
Liapunov [L-6], Blackwell [B-6], and Olech [0-1]. There are, how- 
ever, some technical differences so we include a proof for the s ak e 
of completeness. 

Lemma 3.2* Let / be a compact interval and let H» J? -» £ 

pq 

of bounded variation on J?. Let 2 ! > Pr* be a p -measurable 

H 

compact multifunction. Let p e ^(J^, | p | ,R) be such that 
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diam fl(t) g P (t ), t e J&. Then / £2(t)dEl(t) is compact. 

"S' 

Proof . First we observe that by the Lebesgue-TTikodym theorem (for 
example see [D-3, pg. 2 6j]) there is a | u | -integrable function 
B! jfl -» £ such that 

pq. 

/^.g(t)dH(t) = S g(t)B(t)d|H|(t), g 6 c£ 1 (^p h ,R P ). 

We write T = a + v where cn is the saltus function of T tt and v 
is continuous. It is an -easy matter to prove that the multifunction, 
t -> 0(t)B(t)., t e J^is measurable where 0(t)B(t) = (x e R°[x = yB(t) 
for some y e ft(t)}. Moreover, diam ft(t)B(t) g p(t)|B(t)j, t e J?T 
One can also verify the identities! 

(3.i) / n(t)dH(t) = / n(t)B(t)djH| (t) = / Q(t)B(t)da(t) 

Jr J? Jr 

+ /^fi(t)B(t)dv(t); 

the proof of the first equality is facilitated by versions of Filippov' 
selection lemma [C-3,- J-l] , and the second equality follows from the 
definition of a and v. Wow is purely atomic and is’ 

nonatomic so the conclusion o'f the lemma follows from (3-1) and a 
remark of Olech' s [0-1, pg. 100], (see [C-3] also for the nonatomic 
case) . 

Lemma 3.3 . Let H and be as in Lemma 3-2. Let fi! j? r p 
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be a multifunction with a Borel measurable selection; that is there 
is a Borel function g*! y~> R P such that g*(t) e ft(t) for each 
t e y. Then t)dH(t) coincides with the set J^(ft,H) = 


{/^,g('t)dH(t)| the function gl -» R P 
g(t) e Q(t), t e y) 


is Borel measurable and 


Proof ., Clearly &(Q } E) C /^.ft(t)dH(t) . Conversely suppose 

g e g(t) e ft(t), t € /, Then there is a Borel set 

E^ C with p (E ) = 0 and there 'is a Borel function 
o H o 

&' y -» R P such that g = g on y \ E [R-l, pg. 225]. Using 


Xg for the characteristic function of a set S we see that g = 


+ g X *Xg is a Borel function satisfying 
o o 


g(t) e H(t), t € J? 1 , and g = g a.e. 
/ g(t)dH(t), and so / g(t)dH(t) e 

y y 

proof . 


[p ]. Hence / g(t)dH(t) = 
H y 

jO$(Q,,K). This completes the 


In preparation for the next lemma let us introduce some 

<v <v 

additional notation. F,GI [0,°°) x R -» are mappings defined by 
the following two relations. 


^ T 

F(t,s) = / F (a, s -a) Y (a, t ) da, 
o 

~ t 

G(t,s) = / G(os,s)Y(a,t)da, t a 0, s e R, 
o 


where F,G, and Y are the functions defined in section 2 which 
appear in equations (2.5) and (2.7). We define a function 
t&\ R m X R -» R m x R n by the equation 



14 


~ (u,h(u,t)), t e R, u s R ffl 3 

where h is the function introduced in section 2 (see equation (2.3)). 
A function I‘ I [0,») x R -» £ ^ ^ ^ is defined 'by the equation 


P(t,s) 



t g Oj s e Rj 


where 0 denotes an jh x n matrix all of whose entries are zero, 
mn 

A multifunction LI R -» R m x R n is defined hy the condition 
L(t) = t s _t. 

Remark 3-2 . The sets L(t), t ^ -t are evidently compacts: Let 

h & 0 he given. If p is any Lebesgue-Stieltjes measure on 
[-Tjh], then the multifunction U| [-T^b] is p-measurable. .This 
follows from the assumption that U is Borel measurable. Using 
Lusin’ s theorem for p-measurable multifunctions [C-3, J-l] and 
extensions of Scorsa-Dragoni* s theorem [C-3, J-2] it can be proved 
that the multifunction t -> L(t) = igf(u(t),t) , t e [-T^b] is p- 
measurable. Hence L| [-T,b] is p-measurable for every Lebesgue- 
Stieltjes measure p on [-T,b]. He note also that because U is 
Borel measurable and compact, there is a Borel measurable function 
u*: [ - T, <») -» R m such that u*(t) e U(t), t § -t [K-3]* Remark 2.1 
shows then that L has a Borel measurable selection. Recall now 
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that 0 was also assumed, to "be Borel measurable. Hence in evaluat- 

r 

ing. either of the integrals 

° t 

/ <Ks)a F(t,s) or / L(s)a r(t.,s) 

-T -T S 

the conclusion of Lemma 5.5 may be applied. 


Lemma 3.h . Let the standing hypotheses of section 2 be satisfied. 
For t a 0 define & t (§,U) to be the set 


° t 

$(0)Y(0_,t) -f / $(s)d g F(t,s) + / L(s)dr(t,s). 

-T -T S 


fhen we have the identitj^ ($.,U) = t § 0. 


^oof. Examining the third summand on the right hand side of ( 2 . 7 ) 
we use the unsyrametric Fubini theorem [C-I] and the assumptions on 
G in section 2 to write 


t a. 

(3-2) / {/ h(u(s) > s)d G(a, s)}Y(cc,t)da = 

O -T S 

t t 

/'(/ h(u(s),s)d GCa,s)}Y(cx,t)da = 

O -T 

t i 

/ h (^(s),s)d s {/ G(a,s)Y(a,t)da}. 

-T O 
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We 'have the identity* 

t _ t 

(5.3‘) / h(u(s),s)d g G(t,s) - / i^(u(s) ; s)d r(t,s) . 

-T -T S 

Consequently from (3.2)_, (3.3), and (2.7) we have 

Since F(t, •) ' is left continuous on (-t, 0) we have that if 

~ X " s n < s n — aS n “3 then lim F(a, s^-o:) = F(a, -a), 

0 < a ^ t. Therefore from the Lebesgue. dominated convergence 

theorem and the definition of F we get that {0} is not an atom 

of p Hence 

F(t, •) 

° o 

/ <P-(s)d . F(t,s) = / 9(s)d ?(t,s) 

-T -T 

if cp(s) = cp(s) except at s = 0. From this remark, the variation 
of parameters formula (2.7), and Remark 3*2 one can show the reverse 
inclusion ) C If the detailed proof of this in- 

clusion is carried out^ then the meaning of the comment in the 
preceding footnote becomes clear. This completes the proof of the 
representation formula of the lemma. 

' 1 LM - r ■ ' 1.. - ' * * ' — i - - . , - , 

Our reason for introducing the auxiliary function tf/ and r is 
to avoid certain questions concerning the existence of Borel 
measurable selections. Halkin used a similar device in [H~5]> 
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Theorem -g.l . Let the standing hypotheses of section 2 be satisfied. 
Then 

(i) The sets .G^^U), t s o axe compact' 

(ii) The mapping t -> s&. ($,U), t § 0 taking its values 

in the compact nonempty subsets of p n is continuous with respect 

to the Hausdorff metric [A-l]* 

(iii) For any t £ 0 the set - U __ (®,U) is compact. 

te[0,t] Z 

Proof of (i) . This is an immediate consequence of the representatio: 
formula in Lemma 3.4 and Lemma 3.2. 

Proof of (iii). This is readily deduced from (ii). 

Proof of (ii) . Let S denote the closed unit ball in R n with 
center at the origin. We must prove that given t^ & 0 and € > 0 
there is a 8 > 0 such that 

(3.^) + eSD and + eS D , jt-tj 8, t S 0. 

The relations in (3*4) can be verified by considering two cases: 

Case (a), t g t n j Case (b). 0 g t < t^. Consider case (a) first. 

Suppose e then there is an admissible triple 

such that x - x^/p^Uj.). Define the function 
u*. [-T,t^] -> p m to be the restriction of u^ to [-T,t_^]. Using 
the variation of parameters, formula (2.7), Lemma 3 . 1, inequalities 
(2.2) and (2.4), hypothesis 4°) of section 2, and some standard- 
manipulations with Lebesgue-Stieltjes integrals we obtain the 


estimate 
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(3.5) |ac(t,q> t ,u t ) - x(t lJ cp t ,u)-j sSM|Y(0,t) - 1(0,^)! + 

t t • t 

M / 8(a)| Y(a,t) - Y(ctjt ).|da + m|e|/ p(a)[exp / p(|)d£]do: 

0 t. a 

+ Mf p(a)|Y(cc,t) - Y(a,t )|da„ 
o x 

We now give a similar estimate for Case (b) . By the Kuratowski-Ryll- 
Nardzewski selection theorem [K-3] there is a Borel function 
[-T.,«>) R m such that u*(t) e ft(t), t l _t. We note that 
W-L = u fc *Xj._ <r + u °X^_ ^ -j is a Borel function - and {cp^n^t^} 
is admissible, for reasons similar to those adduced to support 
(3-5) we get the inequality 

(3.5’) |x(t,cp t ,u t ) - x ( t 1 j ( P v ii 1 )| - m| Y( 0, t) - Y^t^j + 

t t i \ 

M/ p(a)(Y(a,t) - Y(a,t )|da + Mj E J / p ( ck) [ ex:p / p(|)d£]da + 
o t a 

t 

M/ P(a)'| Y(a,t) - Y (a, t^) j da. 
o 

From the continuity of Y (a ; • ) , the Lebesgue dominated convergence 
theorem, and inequalities (3.5) and (3.5*) there results 

(3.6) Given t^ a. 0 and e > 0 there is a 5 > 0 depending only 

on t^ and e such that | t-t, | S 5,. t g o imply • 
|x(t,q> t ,u t ) - x^cp^u)! g e and |x(t,q> t ,u t ) - 

x ( t 1 >V 11 i)l - e * 
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Statement (3.6) implies 


+ eS D J 3 ^ ; |t-t_J ~ b > t S 0. 


The other inclusion relationship in (3 . 1) is proved by a symmetric 
argument which is omitted. 


Remark 3.3 » Let t -» J^"(t), t- g 0 be a compact multifunction 
which is continuous with respect to the Hausdorff metric. If we 
impose a terminal condition of the form 


(3.7) 


xCtj/pjU) € 


then by the usual device [N-2] Theorem 3-1 yields an existence 
theorem for the time optimal control problem. If we consider only 
admissible controls whose domain [-T,t^] lies in some fixed inter- 
val [ -t , and if there is a terminal constraint (3.7) or ) indeed, 
if the right end is free, then Theorem 3-1 can be used to give an 
existence theorem for the problem of minimizing P(x(t ,cp,u)) on 
the class of admissible triples fcp,u, t^} such that (3-7) is 
satisfied , or for the problem of minimizing P(x(t n ,cp,u) ) on the 


Actually for these existence- statements it is not necessary to assume 
that the multifunction is continuous or even compact. It 

suffices to have the multifunction closed (i„e., Jf*(t) is 

closed for t I 0) and upper sernicontinuous in the Kuratowski sense 
(see for example [K-4, J~l]). We keep the stronger hypothesis 

of continuity because it is needed in proving necessary conditions 
for a, minimum. 
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class of admissible triples (qyu,^}, where P is a real valued 
continuous function on R n . 

In order to deduce necessary conditions for the optimization 
problems mentioned in Remark 3°3 it is -desirable to have that the 
sets J3^.($jTJ) are convex. This cannot be deduced under the general 


circumstances of Theorem 3*1 because the Lebesgue-Stieltjes measures 
involved in the representation formula^ ($,U) = of 

Lemma 3.4 can be atomic. It is noted that any function on an inter- 
val [a,b] into £ which is of bounded variation has only a 

pq. • • 

denumerable number of discontinuities. We say that F has property 
.(Aj if for each t e R it is possible to index the points 


-0^(t), 1= 1,2^.,. f in the interior of [-t,0] at which F(t, •) is 
discontinuous } in such a way that continuous functions t — > 6_^ (t)_, t e E, 

s 

I 

are defined and t — > t - 0^(t), t e R is strictly increasing 
i. = l,2j... . We say that G has property (ZV>) if for each t e R it 
is possible to index the points £^(t)y i = 1,2,... in the interior of 
[--r,t], at which G(t, ••) is discontinuous in such a way that continuous 
strictly increasing functions t -> (t), t e E, i'= 1,2,..., are defined. 


Theorem 3 If in addition to the standing hypotheses of section 2 
we assume that $ ( 0 ) is convex, F and G are Borel measurable, F 
has property (A^), and G has property (A-,), then conclusions 
(i ) , (ii)j and (iii) of Theorem 3-1 are still valid and 
t s 0 are convex. 

Before proceeding with the proof we -give another lemma 
that will be useful in the -proof. 
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Lemma 5’. 5 . Let pi R — > R be a continuous strictly increasing func- 
tion. Let fl [a,b] £ be a Lebesgue summable function. . We 

define three functions R -> ^ by the equations 

b 

\(s) = / f(l)l(s-p(l))d| ; s e E, 
a 

b 

W 2 (s) = / f (|)j(s-p(0)d|, s' e R 
a 

b ' 

W-(s) = / f(£)J(-s+p(|))d|, s e R 
J a 

where I,Jl R -> R are the step functions defined by the relations 


I(x) 


0 x g 0 

1 x > 0 


J(x) 


0 x < 0 

1 .x g 0 


Then VI ‘is continuous, i = 1,2,3. 

Proof . First we remark that p: [a,b] [p(a), p(b)] has a con- 

tinuous inverse, p" 1 : [p(a), p(b)] -> [a,b] which is also strictly 
increasing. Some elementary calculations yield the following 


formulas I 
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0 

b 

/ *(£)<*£ 
a 


for s g p(a) 
for s > p(b) 


P" 1 ^) 

/ f(|)d| for p(a) < s g p(b), 


0 


for s < p(a) 


W 2 (s) = 


b 


/ f(S)d£ 
a 


for s s p(b) 


P _1 (s) 

/ f(|) d £ for P( a ) ^ s < p(b). 


and 


Vs) 


0 for 

b 

/ f(|)d£ for 

o 


b 

/ f (l) d l for 

P _ 1 (s) 


s > p(b) 
s g p(a) 

p(a) < s g p(b). 


The continuity of the functions Vh, i = 1,2^5 is an immediate con- 
sequence of these formulas and the continuity of on [p(a) J p('b)], 
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Proof of Theorem 3 .2 . We write F(t,s) = Aj,(t,s) + N (t^s) and 
G(t,s) = A & (t,s) + N Q (t,s) where A^t, •) is the saltus function 
for F(t, ’)^ A (t, • ) is the saltus function for G(t, * ) , and "both 
and. If (t, •) are continuous. Denote the jump of F(t, •) 
at -0..(t) by B ± (t) and the jump of G(t, • ) at £ ± (t) by C^t), 
i = 1,2,... . The jump of F(t, •) at ~t is denoted by B 1 (t) 
and the jump of F(t, \) at 0 is denoted by B (t). The jump of 
G(t, •) at -t is denoted by C ^(t) and the jump at t is denoted” 
"by C Q (t). From .Remark 3*1 and inequalities (2.2) it follows that 

( 3 . 8 ) Z |B,(t)|, Z [C. (t)| g p(t), t e R. 

i=l x i=l 1 

Since F and G are Borel measurable, the functions B.,C.„ 

3 x 3 x 3 

i = -1, 0,1,2, . . . are all Lebesgue measurable. Fox example let us 
show B i .is_ Lebesgue measurable, i a 1. Define s n (t) = l/n - 0 (t), 
n = 1,2,5,. , then s^ft) > -0 i (t) and lim (t) = -©^.(t). Since 
F'(t, •) is left continuous on (-T,0), we have 

BjCb) = lim F(t,s n (t)) - F (t, -0 ± (t) ) . 

Since F -is Borel measurable, the functions t — >F(t,s^(t)) and 
t -» F(t,-0^(t)) are Borel measurable (a fortiori Lebesgue measurable). 
Hence B^ is a Borel function and thus Lebesgue measurable. The 
proof of the measurability of the. other functions is similar. Define 

CO 00 

B(t) = Z B. (t) and C(t) = Z C.(t) (both series converge by ( 3 . 8 )). 
i=l i=l 1 
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The s situs functions A^, and can be written in the form 


(3.9) AyCt.s) - B_ 1 (t)j(-s-T) + (B 0 (t) - B(t))j(s) 


+ Z B.(t)i(s+e . (t)), 
i=l 


and 


A & (t jS ) = C^ 1 (t)j(-s-r) + (C o (t) ~ C(t))j(s-t) 


+ Z C.(t)l(s-£ (t)). 
i=l ’ 


We have 


(3.10) F(t,s) = / Ap(a^ s-a)Y(a^t)da + / iT F (a,s-a)Y(a,t)do: 
o o 

^ t t 

G(t,s) = / A G (a,s)Y(Qi,t)da + / N^a, s)Y(a,t)da, 

.o o 


and the second terms on the right hand side of both equations depend 
continuously on s by the Lebesgue dominated convergence theorem. 
Using (3.8) j (3-9) an d the dominated convergence theorem we get 


(3.11) / A F (a ; s-o:)Y(a J t)da = / B 1 (a)Y(a,t)j(-s+a-T)do{ + 


T 

/ (B Q (a) - B(a) )Y(a,t)j(s-a)do! + 
o 


co T 

Z / B. (a)Y(a ? t)l(s-at0 . (a) )dcs. 
i=l o . 1 
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According to property (A^) and Lemma 5*5 each term in the series 
(3*11) is continuous in s. We also have 


( 3 . 12) |/ B i (a)Y(a,t)l(s-<w-e i (a))dof| g K[e [ f j B ± (o;) | d. 0 ;^ 


i - 1,2, 


t 

where K = exp / p(|)d|. Moreover, the series 

co t 0 . 

Z / jB (a) | dec converges "by (5*8). Hence hy the Weierstrass M-test 
i=l o 

and (3.12) the series in (3. 11) converges uniformly for s e [~t,0] 

T 

(t ^ 0 is fixed). Therefore the function s - 4 / A(a, s-o:)Y(o:,t)dD!, 

o 1 

~t g s g 0 'is .continuous, and we conclude that F(t, *) is continuous 
° n [-T, 0] for each fixed t S 0. By an entirely parallel argument 
it can be shown that G (t, * ) (also r(t, •)) is continuous for each 
fixed t s 0. Using the Lebes gue -ITikodyir. theorem [D-3, pg. 263 ] it 

j 

is detemined that there exist integrable Borel functions 

V I [-t,0] -» £ and V ! [-T,t] -» £ / \ sxich that 

e; L nn r L * J (mfnjn 


o o 

/ <p(s)d F(t,s) = / cp(s)V^(s)d[p^ 

-t -t F F(t, •) 


for 9 eA([-T,0], , R n ) and 

F(t, •) 

t t 

/ g(s)d s r(t,s) = ; g( s )if r ( s )a|n r(t ^ ) |, 


for g * h* r(v) 

in Lemma 3<A and an extension of Filippov's selection principle 
[G-3 j J-l] we obtain 


Pi). From the representation formula 
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o 

(3.13) 'jar (®,u) = ®(o)Y(o,t) + / ®(b)v^(b)cl|^ | + 

* -T F F(t, • ) 

t 

/ L(s)V r (s)d|p- r ^ ^1 . 

By Remark J.l |n | and ]u , ., | are nonatomic, and we 

F(t,-) 

conclude that _Q^.(<I>, U) is convex (see [0-1, C-3]). 

We shall use co (B) to denote the convex hull of a set 

B C R P . 

Corollary 3.1 « Let T denote the multifunction, t -» co ($(t)), 

-t g t S 0 . Let U** [-t,<») -^R "be a Borel measurable compact 
multifunction such that diam (U*(t)) g M and co (h(U(t),t) ) = 
co (h(U*(t),t)) for t I -T. Let the hypotheses of Theorem 3. 2 he 
satisfied. Then 

J2f t ($,u) = t a o. 

Proof . The identity is easily verified hy using equation (3.13 ) , 

the linearity of V (s) and V (s) and Theorem 7-1 in [C-3]. 

F 1 

As a particular case of Corollary 3.1 we obtain I 

Corollary 3.2. Let the hypotheses of Corollary 3-1 "be satisfied. 
In addition suppose T (t) is the set of extreme points of T(t), 
and U . [ - t, co) — > R is a multifunction such that diaia U (t) g M 
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and the set of extreme points of co (h(U(t),t)) is equal to 
h(lr(t),t), t £ -T. If the multifunctions V .and U 7r are compact 
and Borel measurable, then 




t § 0. 


Remark 3*^ ° In Theorem 3*2 it was assumed that $(0) is convex. 

If this should happen not to he the case, then one can always select 
$ o , a compact convex subset of $(0) (for example $ o could he a 
singleton point set), and define 


®*(t) 



t / 0 
t = 0 


Since is also Borel measurable, compact, and satisfies 

diam 1 (t) S M, t e [ -t, 0] we could replace 0 by and 

Theorem 3*2 could be applied. 
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§^. Necessary Conditions' for an Optima'!' Con trol, The 
properties of the attainable sets deduced, in section 3 suggest that 
the main geometric ideas involved in proving the maximal principle 
for ordinary linear control problems (see [L-3]) are -going to retain 
their validity for certain of the optimization problems formulated 
in Remark 3*5. We shall only consider the time optimal control 
problem mentioned in Remark 3 .3 o It will be clear from the dis- 
cussion that the results -can be used to prove a maximal principle 
for the other problem discussed in the aforementioned remark if we 
add additional assumptions which assure that on compact convex sub- 
sets of R n the mapping P assumes its minimum on the 

boundary of e.g.^ when P is linear (cf. [H-2]). 

The following lemma is true and the proof is in effect 
given in [L-3]. 

Lemma 4.1 , Let 8i®> [a_,b] R n be compact multifunctions which 
are continuous with respect to the Hausdorff metric. Let S(t) 
be convex for a S t S b. Let t' e (a,b] be such that 5(t ) D 
© 0^ ) 4 - 0 321,1 5(t) 0 @(t) = 0 if a S t < t*. Then 

x e 5(t' ) fl © (t ) implies x e 3 & (t ) . 

We shall use. <X^y> to denote the scalar product^ x ; y e R n ^ 
and A’ to denote the transpose of a matrix A. 

Theorem 4.1 . Let the hypotheses of Theorem 3 . 2 be satisfied. If 

ft ft 

(cp ,t } is an optimal solution to the time optimal control 
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problem in Remark 5.3, then there is a function ifrl [0,t*] -> R n 

which is of hounded variation and satisfies the adjoint equation 

* 

* -v 

t(s) + j t(a)F,’ (cs,s-a)da = e, 0 § s g t , 
s 

where e is an outward normal to a support hyperplane to the set 

through the point x(t ,<p ,n ) on the boundary of 
t 

x ($,U), such that 
t 

1°) <p"(0),t(0)> § <!p o ,t(0)>, cp o e ®(o); 

x o 

2 °) / </ <p*(s)d F(a,s-a),t(a)>da § 

o _t s 

T O 

/ </ cp(s)d F(a,s-oi) ,,i[r(Q!)>dQ: 
s 

O -T 


for every admissible cp’ 


* * 
t • t # 

5°) I </ h(u' (s) J s)d G(a,s),iir(a)>dQ: § 

o -t s 

t* ‘ t* 

/ </ h(u(s),s)d G(a,s),t(a)>da. 

o -t s 


for every admissible u. Moreover if is equal to a fixed 

compact convex set £ C R n for t g 0 ; then e can be picked to 

satisfy the transversality condition: e is normal to a common 

support hyperplane separating S>f , A (b,U) and X. 

t 
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"X" ' ■X' "X 1 -x* 

Proof. Let x = x(t ,(p ,u ). By Theorem 3.2 and Lemma 4.1 we in- 
x- 

fer that x "belongs to the boundary of cyf x . There is a vector 

t 


•_U 

e e R with 


e| =1 such that 


max (,<e^x>|x e S0 = <e,x*>. 
t 

Using the fact that the value of cp(o) does not affect the value 
of the second term on the right hand side of (2.7) (cf. proof of 
Lemma 3.4) ^ and some elementary reasoning involving formula ( 2 . 7 )' 
it can be shown that 


(4.1) (a) i)"(0) 3 eY'(0,tV^ o ,eY'(0,t")>, cp Q e ^(0); 


* 


(h) </ <p (s)d 


-T 


/ E(a/S-a)x(a:,t )daj 
o 


e> ^ 


</ <p(s)d 


-T 


- 


/ F(a,s-o:)Y(a:.t )da 


, e> 


for every admissible cp j 


* 


(c) </ 


* 


/ h(u (s) ; s)d &(a ; s) 
-T S 


* 


Y(<x, t )da, e> a 


* 


</ 

o 


* 


/ h (u(s);,s)d s G(a,s) 


* 


Y:(a, t )da, e> 


for every admissible u. Define . ^(a) = eY* (a,t ) } 0 g a = t . 
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Then "by appropriately using the unsymmetrie Fubini theorem [C-l] and 
some standard manipulation with the scalar product in (4.l)b,,c, 
relations 2°) and 3°) are proved. The fact that a — > t|t(q:), 0 g a, g t* 
is of hounded variation and satisfies the adjoint equation is an 
immediate consequence of (2.8). 

The transversality condition is just a geometric property. 

In proving this condition we use the norm in R defined by |x[ = 

<x,x>. We have (1 £ = } for 0 g t < t*. Let t e [0,t*) be 

such that t -it as n co. Let a e srf, , b e £ be such that 

" XX "y XX 

n 

la n -b n ( is the minimum value that the function (x,y) -e jx-y|, 

(x,y) e J3^ x £ assumes. Then a^ - b^ ■} 0 and = 

(b n -a )/] a -b [ is a unit outer normal to stf. at a and a unit 

n 

inner normal to X at b . Hence 

• n 

(4.2) (x|<e n , x-a^> g 0} Z> J& t 

n 

{x!<e n ,x-b n > S 0) D £, n = 1,2,3,... • 

We might as well assume e -> e and b -> b as n -»co. Then a 

n n n 

also converges to b. Using (4.2) and the fact that -> * 

n t 

as n -> co (the limit is taken with respect to the Hausdorff metric) 
we find that 


[x|<e,x-b> g 0) D jaT # 

t 


(x[<e,x-b> ^ 0} D % 
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so that - 7 r = fxj<e,x-b> =0} is a hyperplane satisfying the trans- 
versality condition. 


Remark 4.1. We can put conditions 2°) and 3°) of Theorem 4.1 in a 
form which will in many cases he more manageable if we assume that 
j(t, *) and G(t, •) have no singular part and if the functions 

i = 1,2,3,... introduced in properties (A^) and (A>) are 
of class c\ Let us indicate the form which 2°) and 3°) take in 


this case. We use the decompositions F = Ap + Np and G = A^ + 
which were introduced in the proof of Theorem 3*2. According to 


our assumptions H F (t, *) and W & (t, • ) are absolutely continuous. 

By some rather involved analysis, which includes several applications 


of the unsymmetric Fubini theorem [C-l], it can be shown that condition 
2°) of Theorem 4.1 implies 


2°) <Ep*(s),P(.s)> g <Ip(s),P(s)> a.e. on [-T,0J 

for every admissible cp where P is defined by 

CO 

P(s) = -^(s+t)B , 1 (s+t) + I ^(p" 1 (s))B^(p“ 1 (s))K i (s)v i (s) 

i=l 

T 

+ / t(a)^ (a,s-a)da, s e [-t,0], 
o 

and P^(a) = a - for a e [0 ,t], denotes the characteristic 

function of [p^O), (tt) ] fl [-t,0], and v^s) = l/fbCp^Cs) ) for 
s e [ - t, 0 ] , i = 1,2,3,... • By a similar type of analysis which is 
again omit ted. 3°) can be shown to imply 



33 


3°) <&fa*(-T),-T), S <h(u(-T),-T), tCOc^Cfe)^ 

-X 

a.e. on [0,t ] ; 

and 

<n(u*(&),£), Q(l)> § <h(u(i),0, Q(S)>, a - e - on [- T ,M 

for every admissible u where Q is defined by 

Hi) =t(0(c;(e) - c(O)j^u) + E 4r(q J ‘(6))c*_a‘ 1 (i))j^ i (OP i (0 

* * i=1 
t 

+ / (a>O d a 

o ^ 

-X 1 

and 3^ is the characteristic function of [O.t ], 5 ^. is the 

i o x 

characteristic function of [£^(0)^ £^(t )]^ and fk(|) = 

-x- 

-T Si £ — t o 
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§5. Analyticity Results Tor Solutions of ffDE'-s . As the 
reader is hy now well aware, the representation (2.7)- of solutions 
to (2,5). in terms of "fundamental" or "adjoint" matrix solutions 
[B-l] is of immense importance in the study of control of such sys- 
tems. In this section we investigate analyticity properties of 
these fundamental matrix solutions for certain types of linear (in 
the state variable) systems which are special cases of (2.5 namely 

K o 

(5°1) x(t) = Z x(t-6 i )A i (t) h- / x(t+s)A(t,s)ds + h(u(t),t) 
i=c -T 

with 0 - 0 Q < 0^ < . . . < 0^ g f, which correspond to an F(t, *) 
consisting of an absolutely continuous function plus a saltus func- 
tion with a finite number of constant (in t). jump points. The 
associated fundamental matrices X(t,o) satisfy (as a function of 
t.) 

. K o 

"(5°2) X'(t ) = Z X(t-0.)A. (t) + / X(t+s)A(t,s)ds, t > cf 
i=o -T 

X(cr) = E, X(t) = 0 for t <- ff. 

Since the corresponding adjoint matrices Y(cr,t) satisfy (in cr) 
systems [H-l] which can be put in a form similar to that of (5.2) 
and since we have X(t,o) = Y(cr,t), to investigate analyticity 
properties of X and Y in a or t it suffices to examine the - 
analyticity in t of solutions to (5-2). Considering the following 
two examples one sees that systems of the type (5.2)- with analytic 
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coefficients and analytic initial function need not possess an 
analytic solution. 

Example 5.1 . The scalar system 

x(t) = x(t-l), t > 0 
x(t) = 1, t e [-1,0] 

has a unique solution on [-1,2] given by- 

/l, t e [-1,0] 

x(t) = < 1 + t, t e [0,1] 

b/2+t 2 /2, t e [1,2] 

which is not analytic at t = 1. 

Example 5.2 . The scalar system 
o 

x(t) = / x(t+s)ds, t > 0 
-1 

x(t) = 1, t e [-1,0] 


has a unique solution on [-1,2] given by 
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x(t) = 


1 + 


1 + 


simh t, 
sinh t - 


t e [-1,0] 
t e [0,1] 


Z 


n=l 


(n-l) 


( t - l) 2 * 1 - 1 


t € [1,2], 


which, is not analytic 'at t = 1, 


Remark 5«1 « Example 5.1 can he used to contradict a theorem of 
Pinney ,[P-1, p. 237] while Example 5.2 contradicts a result due to 
Oguztoreli [0-2, ‘p. 52] „■ (it is not difficult to show that the 
right side of the system in Example 5.2 is analytic in x in the sense 
of Volterra [V-l, 0-2] as required in Oguztoreli' s theorem.) 

In light of the previous examples and remarks one might ex- 
pect under reasonable assumptions on the coefficients to obtain not 
analyticity but some type of piecewise analyticity for solutions to 
(5. 2). We are thus motivated to introduce. the following concepts 
(see also Halkin [H-4] and Levinson ’[L-4] ) 0 A function f l R -» R 
is analytic on [a,b] if there exist e > 0 and a function g 
analytic on (a-e, b+e) such that f = g on [a,b]. We say that f 
is piecewise analytic (pwa) on [a,b] if there exists a partition 
a = s < s. < ... < s = b such that f is analytic on fs. , 
i = 1,2, . ..,v. Finally, f is said to be -quasi piecewise analytic 
(qpwa) on [a,b] if there exists a partition- a = s q < s^ < . . . < 

= b such that f is analytic on (s i .^s ), i = 1,2, „.„,v. 
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Combining a modification of the step-method [E-l] with 
known results for ordinary linear differential equations we can prove 

Theorem 5.1 . Let A(h,s) = 0 in (5.2) and t->A.(t), i= 0,1,... ,K 
he (real) analytic on [cr,~) into If the lags 0 i = 1,2, 

. ..,K, are commensurate, then the solution to (5.2) is pwa on 
[a, cr-t-T] for any T > 0„ 


Proof . We shall give the proof for K = 1, 0=1 since it will 
then he clear how one extends the results to cover the case of a 
finite number of commensurate lags. Thus we consider the system 


(5.3) X(t) = X(t)A o (t) + X(t-l)A 1 (t), t > a 

X(a) = E 

X(t.) = 0, t < a 

and denote hy SB the solution of 

2B(t) = 9B(t)A Q (t) 

SB(cr) = E. 


From the theory of ordinary differential equations it is known that 
SB and SB 1 exist and are analytic on (a-e, cr+T+e) for some 
e > 0. Since the solution X of (5.3) agrees with 3B on [<j,oh-1], 
we have that X is analytic on [ct,cf+1]. Furthermore, we see that 
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(5.*0 'X(t) - {X(u+n)5B ± (.cr+n) + / X(s-l)A 1 (s)SS“ 1 (s)ds]2B (t) 

a+n 

for t e -[a-bn, crfn-fl), nil. Hence the analyticity of 2B, SK , A^ 
on [ cr+1, g+ 2 ] , and that of X on [cr,cf+l] imply that X is 
analytic on [cr+1, 04-2], which by the same reasoning leads to the 
analyticity of X on [c+2, cr+3] . A finite number of repetitions of 
this reasoning using (5 « h.) completes the proof „ 

Remark 3.2 . From the definition of the determinant it follows 

immediately that if [a, (3] is any interval of analyticity of X 

(the solution to' (5=2) with A(t, s') = 0), then either X is singular 

on - [oi,p] or else there are at most a -finite number of points in 

,[«,£] where X“' 1 (t) fails to exist. 

I 

Just as the step-method fails in existence proofs for (5.2) 
whenever A (t , s ) 0, this form of the step-method will not be of use 

in proving analyticity results for solutions to the general system 
(5.2). We can, however, obtain the following result by utilization 
of successive approximations with step-like procedures. 

Theorem 5.2 . Suppose that (t, s) -+A(t,s) and t — >A^(t), 
i - 0,1, ...,K, are (real) analytic oh ‘ [cr,o°) x [-T,0] and [o,<») 
respectively into £ „ If the lags 0_, ,0_, . . . ,0, ,t are 
commensurate, then the solution to (5=2) is qpwa on [o,tr+T] for 
any T > 0. 

Again, we shall here give a proof of this theorem only for 
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the special case 


o 

(5.5) X(t) - X(t)A 0 (t) + X(t-l)A 1 (t) + / X(t*s)A(t,s)ds, t e [0,T], 


X(0).= X(t) = 0 for t < 0, 


as it will then be easily seen how one modifies the ideas to obtai 


the result for commensurate lags on [o } a+T] . Since the uniform 
limit of a sequence of real analytic functions need not be analyti 


if we wish to use successive approximation techniques to obtain 


analyticity results^ then we must work with complex systems. That 


iSj we must somehow replace (5-5) by a system defined on a domain 
the .complex plane (£ which contains [-1,T] so that the system 


is equivalent to (5.5) on [-1,T] . Before beginning the proof we 


give sonje preliminary results which will be needed. 


Lemma 5»1. If f is analytic in a region .S^(a,b) = (z = x+iy| 


a < x < b, -d < y < d} and continuous at z = a from within 

z 

^(a,b), then F defined by F(z) = / f (£)d£ is an analytic function 

a 

on S/{ a,b) . 


Proof . From the extended form of Cauchy' s theorem [W-l] it follows 

that F is independent of path in a,b) and is thus well defined. 

For z e ^(a,b) in a neighborhood of z e J/Ta/o) we have 
z 

F(z) = F(z ) + / f(£)d£ which is analytic at z q by well-known 
z 

o 


results. 
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Lemma 5.2 . Suppose (t,s) -»oi(t, s) is real analytic on 

2 

(-e, Tfe) x (-1-s, e) C R . Then there are sets and 5^- in (X. 

of the form: 

- [z = x+iy|xe(-S,T+6), ye(~5,5)} 

= {z = x+i-y|xe (-1-6,5), ye(-5,6)} 

and a function (z,w) -> Cfi (z,w) analytic on X C <t such 

that a j K = a where K = ■'{ (x, 0-) | xe[0 , T] } x ( (x, 0) j xe[ -1, 0] } (or 
K = [0, T] x [-1,0] as a subset of R^). 

Proof. Define 2# - (-e,T-t-s) X ( 1-e, e), which is an open region 
2 

m R on which a is analytic. It then follows [N-l, p. 5] and 
[H-8, p. 4lJt2] that there is an open set in (L ' with 

^ i y i ^ 

flS =f and an analytic function a on 3> such that 

*■. 2- 
a |^ = a. The set K- defined in the lemma is compact in - <L and 

2 * 2 

Kn (jj ) is empty since K ft R C It is then not difficult 

to show that there is a & > 0 such that' J7L and. as defined 

o o 

in the lemma satisfy K C ST* X Sr* C & . 

o o 

Proof of Theorem 5.2 . Our first task is to somehow extend system 
(5.5) (or, as in the usual case of successive approximations, its 
equivalent in Integral form) to a system on a complex domain where 
of course we want all coefficients involved to be analytic. From 
Lemma 5-2 and standard arguments it follows that there exist domains 
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-5^, (see Lemma 5*2) and analytic continuations (which we again 

denote by A and A^) of the mappings (t, s) ->A(t,s) and t -> 

A., (t) to _5^ x S/? 6 and respectively. Let ^ and 

■ — ' 

be 8/2 neighborhoods in (L (using the usual norm in <L ) of the 
sets [-1,0] and [0,T] respectively. These are the regions on 
which we shall work throughout the remainder of the proof. 

For k any integer, we define = (z e (£ |k < Re (z) < k + 1} 
0 (^U ^ 7 -)- We shall consider the system defined for 
z e S -U {k+1} , k > 0 by 

(5*6) X(z) = E + / (X(£)A (0 + X(£-l)A (£) 

[ 0 ,*] 

+ / X(£+w~)A(£,w)dw}d£ 

[-1,0] '■ 


where we must indicate the paths of integration to be. used. The 
path [0, z] for z e U [k+1] consists of straight line segments 
joining -z and k, k and z-1, z-1 and ' k-l,..\ .,z- (k-l) and 1, 
1 and z-k, z-k and 0. Note that the path will always lie in 

The integral / . X(£*w)’A(f;,w)dw, for £ on the polygonal 

- 7 [- 1 , 0 ] 

path joining 0 and z described above and ( e U [im-l], is to be 
integrated along the w-path of straight line segments joining, 0 and 
-£ + m, -£;+ m and -1. Hence for any £; e S' U (m+1) this latter 
integral depends- on the values of X along the segments joing £ 
and m, m and £ - 1, Note that for z real the system (5*6) 
with the proper initial conditions reduces to the integrated form 
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(in the usual sense) of (5 .5) < 

We next obtain a quasi-slabwise analytic (i.e., analytic on 

S^, k = 0,1,...) solution to (5.6). To do this we define successive 

approximations X , show that each is analytic on S , k = 0,1,..., 

and that {X ) converges uniformly on each S, . The limit function 

will he the desired solution. Define for n = 0,1,2, . . .,X (z) = 0 

for Re (z) < 0 and X (0) ~ E. For z e S U [k+1], k = 0,1,2,.,. 

n is. • 

define X (z) = E and 
o v J 


(5.7) x n (z) = E + / 


[0,z] 


(X n _i(0A o (0 + ^(£-1)^(5) 


+ J X ,.( £+w) A (£ , w)dw] d£ 

[- 1 , 0 ] “ 


for n = 1 , 2 ,..,, where the paths of integration are the polygonal 

paths described above. Note "that each X , n g 1 is defined on 

n-> 

Qi U less the rays U (z = k+iy|y 0}. 

™ y k^o 


We shall say that a function g is left continuous at 
z = k, k g 0, if g(£) -> g(k). as £ -> k, £ e S ", A similar 
meaning is attached to "right continuous at z = k" . Finally, we 
shall say that -g is continuous at z = k if it is both left and 
right continuous at z = k in the above sense. We now state and 
prove an induction lemma which will yield analytieity of X n on the 


Induction Lemma. Let n g 1„ Let k § 0. Then X . 
n-1 


analytic on 
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S -l> V S l'‘” ,S k and continuous at z = 0,1,2, . . . ,k imply X 
analytic on S^_ and continuous at z = k. 

Note. Since clearly none of the_ approximations are left continuous 
at z - 0, we understand "continuous at z = 0" to mean "right 
continuous at z =' 0" in the above lemma. 

Pcoof. Suppose the assumptions of the induction lemma are true. 

We can then establish 


Lemma 3.3 . Let -m be a fixed integer, 0 S m S k. For 
£ e U {m} U {m+1} define 

*( t) = / X (^w)A(^w)dw. 

[-1,0] n - x 

Then F is analytic on S , right continuous at . z = m, and, if 

m * } 

m < k, left continuous at z = m + 1. 

Use of the hypotheses of the induction lemma and Lemma 5-3 
yield that the integrand 


y(t) = \ 1 (0A o (^) t.x a-l)A (0 + / X (^w)A(^w)dw 

[- 1 , 0 ] 


in (3 c 7) is analytic on - S^,^, . . 1 and continuous at 

z = 0,1, ...,k-l, left continuous at z = k. Hence by the extension 


of Cauchy's theorem (see the proof of Lemma 3.1) the part of the 



integral in (5-7) from 0 to .k along the polygonal paths is 
actually independent of path (as long as the paths cross the lines 
Re' .(z) .= m through the point z = m) . Thus, (5-7) may -he written 

*z» 

(5.8) X n (z) - E + / Xe)45 + / J^)d£ 

o k 

Z 2 

where as usual / denotes integration along the straight line 
Z 1 

segment joining and z^,. The -first integral in (5.8) is now 

independent of z e S^. Thus we need only show that the second 

integral is analytic for z e S^_. But this follows immediately from 

the hypotheses of the induction lemma, Lemma 5-5> and L emm a 5.1. 

We therefore have X analytic on S, . 

H j£ 

We shall next argue that is right continuous at z = k) 

the arguments for left continuity are not dissimilar and will he 

z 

omitted. - From (5-8) we have X R (z) - X^(k) = / _y(£)d£ for z s S fe , 

k 

the integrand being analytic on S v and right continuous at 

z = k. Thus is hounded in some "right neighborhood" of z = k, 

from which the desired result follows immediately. To complete the 
proof of the induction lemma it remains only to establish the 
validity of Lemma 5.3. 

Proof of Lemma 5.5 . Making the assumptions given in the statement 
of the induction lemma, we let m he a fixed ■ integer, 0 g m g k. 

Then F(£), £ e S , can be written 



-£+m o 

F(0'= f X nl (^+w)A(^w)dw + / ‘X 1 (£+tt) A(£,w)dw 
’-1 -£+m 

m ’ S 

= / x n _i( w ) A (^ w “£) dw + / X j 1 . 1 ^) A (^ >¥ ^) dw ’ 

£-1 331 


The right continuity of F at z ~ m follows from the continuity 

of A } the "boundedness of 1 in right and left neighborhoods of 

z = m and a right neighborhood of z = m - iy and the theorem on 

dominated convergence. For m < k the proof that F is left 

■continuous at z = m + 1 is similar. (If m = k these arguments 

are no longer valid- in obtaining left continuity of F at m + 1 

since at this stage in the induction we do not have that X , is 

n-1 

left continuous at k + 1^ which is needed for the boundedness 

conclusions about X , 

n-1 

We turn next to the analyticity arguments for F on S . 

m 

We shall argue that the function f defined by f (£) = 


i 

f X^ ^(w)A(£jW.-£)dw is analytic on 


m 


valid for the term / X , (w)A((yw-£)dw 

5-1 n 


similar -arguments being 
in F above . 


Fix e S • For 5 in a sufficiently small neighborhood 
of we caa write 


£ 


£, 


/ X n _ 1 (w)A(5,w-5)dw = / X 1 (w)A(5,v-5)'dw 
m m 

£ 

+ f (w)A'(5;w-5)dw = h n (5) + h 0 (5) 


£, 


where the integrants are analytic in 5 on 


A/ for each fixed 
o 



w 6 jy and analytic in w on J/ for each fixed ' t e jY . A 
o o 5 o 

straightforward application of Morera 1 s theorem establishes the 

analyticity of h n on yV . Use of a theorem of Hartogs-Osgood 

£ 

[H-9, P- 28] yields that h ? is of the form / g(w, £)dw where g 

^o 

is analytic in yV ( ^ x yV Q , from which the analyticity of hg fol- 
lows easily. 

Having confirmed the validity of the induction lemma, we 
point out that it follows directly frcan the analyticity properties of 
X q (recall X q (z) = E for z e U {k+1}, k = 0,1,... and 

X (z) = 0 for Re (z) < 0) and the induction lemma that each X 
is analytic on each S fc . 

We next prove that the sequence (X^) converges uniformly 

on the region of interest. Let f be the positive integer (f > T) 

such that " 0 tor k = I and S ^ / 0. (Recall the definition 

of S, , and ) We shall show that the sequence {X } con- 

verges uniformly on 9? = (J S, U [k] . We note that we trivially 

k=o * 

have uniform convergence of {X^} on S ^ U (0} to the function X 
defined by X(z) =0 for z e S ^ X(0) = E. Recall now the 
definition of X^ given in (5.7) and the integration paths employed. 
For any z e 3? let s (z) denote the arclength of the polygonal 
path described above (see (5-6)) which joins 0 to- z. Let M 
be abound for |A q (£)I, \\(£)\ , £ e and [a(£,w)|, (£,w) e 
0)^- X Qtf Then for z e ft we have 
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|Xj.( Z ) r - X o (z) i = 1/ {X (£)A o (0 + X a-l)A (£) 

[ 0 ,z] 


+ / X (£+w)A(C,w)dw}dC| 

r-i,o] 


g / {|A o (0l + |A 1 (0| + I |A(£,w)| |dw[) jd.^1 

[0,z] [-1,0] 


s/ {M+ M + M(l+2(°))}|a£| 

[0,z.] 

g 3M(l+8)s(z) = ps(z). 


Furthermore , 


|X (z) - X (z)i g / {M|X CO - X (C)| + M[x, (£-1) - X (Ol)| 
[0,b] x ° ± o 


+ / MjX x (£+w) - X (5+w)| |dw|}|dO 

[- 1 , 0 ] 


For f e S we have 
b o 


; M|x (t+w) - X (£+w)| jdw| = ; m[ X (r+w) - X (t+vr)| |dw| 

[-1,0] i -£ 1 ° 


o o 

g / Mps (£+w) [ dw| g / Mps(0]dw| 

-C -5 


g Mps (0(1+8). 


For £ e Sj., k a 1 we find that 



1(8 

(5-9) s(£+w) g s (£) 

for any w lying on the path consisting of straight line segments 
joing -1 to -£ + k and. + k to 0. Hence the above 
estimate is also valid for these values of It follows that 

jX 2 (z) - X (z) | g / (Mps(£) + Mps (£) + Mps(£)(l+S)}jd£[ 

[0,z] 

g 5M(l+8)p / s(5)|-d£l 

[0,z]- 

= p 2 . 

2 

Using this estimate and the above ideas it is easily shorn that 

IX, (a) - X b (z)| g p 5 [s(z)]3 
^ _ 

and' in general 

|x (z) ■- x n (z)j g P n Msl£ 

1 n n-1 1 nl 

for z e 9? , Hence for n > m we have 

(5.io) |x n (0 - -x (*J| * Z |x (z)-x (z)| s Z.p^hWf 

0=bh- 1 d d j=m+l J * 

But for z e 9? we have that s(z) g f (1+2 (8/2)) = f (1+5) . Using 
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this with (5.10) yields the uniform convergence of [X n ] on 9?. 

Let us denote hy X this limit function on 9t U S Since each 

X is analytic on S, and continuous, at z - k, we have that X 

also possesses these properties. Furthermore, for each n. X (z) 

? > n 

is real valued whenever z is real, from which it follows that X 
is real analytic on (0,1), (1,2), etc. Finally, since X 4X on 
[“1,1] it is not difficult to argue that X is the unique solution 
to ( 5 * 5 ), which completes the proof of Theorem 5.2. 

.One might reasonably expect a stronger type of analybicxty 
(say pwa) than that obtained in Theorem 5.2 to be true for systems 
of the type (5.2) even with A ^ 0. The authors have tried un- 
successfully so far to obtain these stronger results. Several ideas 
using different integration paths in defining the successive 

s 

approximations (see the proof of Theorem 5.2) and stronger assumptions 
on the coefficients have been tried. These lead to either a lack 
of analytic ity of the estimates in the desired regions, or else an 
inability to obtain uniform convergence of the estimates. The authors 
were able to prove that the solution to (5.5) is analytic on [0,1], 
but could not adapt these methods to prove analytic ity on [k,k+l] 
for k > 0. The fact that one is using a zero initial matrix on 
[-1,0) appears to be essential in obtaining analybicity on [0,1]. 
(Note that in this case the system loses some of its lag behavior 
on [0,1] and is much more like an integral equation.) 

The analyticity results obtained in this section can be 
-used to study the zeros of the multipliers in the maximum principle 
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for control problems involving functional differential equations 
(see Remark 5.2 and [B-2^ B-3, B-4, H-2]. The information thus ob- 
tained can be especially useful when the maximum principle is also 
a sufficient condition for optimality (see [H-2] ) „ Another applica- 
tion of these analyticity results is discussed in the next section. 
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§6. Application of the Analytic ity Results , We shall use 
pwc as an, abbreviation for piecewise continuous , and when we say a 
function f I [a,b). — >R^ is piecewise continuous we are taking the 
standard definition. We shall say that f is almost piecewise 
continuous (apwc) if there is a finite number of points s. e [.a,b], 
i = 0,1, . .«,N with the property that fj [a,f3] is pwc for every 
[o,P] C [a,b] for which s i £ [a,P], i = 0,1, ...,N. 

In this section we shall demonstrate how some -of the work 
with- -subintegrals of multifunctions by Halkin and Hendricks [H-6] 
and the related -existence theory for piecewise continuous optimal 
controls [H-5] can be applied in special cases of (2„3) to give 
analogs -of Theorem 5-2 when the. admissible triples {cp,u,t} are 
required to be pwc (or apwc ) (i.e 0 , cp and u are pwc (or apwc)). 

i 

'■ Lebesgue measure will be understood in all -of the integrals 

appearing in this section. Suppose a multifunction Ht [a,b] — > Pv* 

b 

is given. Then we have defined / H(t)dt and with [a,b] under - 

a 

'stood ’we denote this by / H. We define 


* 


/ H = {/ g(t)dt[ g! [a,b] R P is apwc and -g(t) e H(t), t e [a,b]}. 


* 


Lemma 6.1 (Halkin- Hendricks) . / H is convex. 

We omit the proof. Let it suffice to say that the proof of 

Theorem 1 [H-6, pg. 365] may in effect be repeated. One need only take 

f, and f 0 to be apwc in that proof and observe that f, ■ X + 

12 * 1 [a,b]\E 

f^-Xg is apwc if EC [a,b] is the union of' a finite number of intervals, 
A set ECR^ is said to be semianalytic (see Lojasiewiez 
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[L-7] or Halkin and Hendricks. [H-6]) if for every point in R q 
there exists a neighborhood V of that point such that 

k 

E (1 V = U {x e R g [ f (x) = 0 and g (x) >0 for j = 1,2 .i} 

i_l > 

where g ± . and f ± are real valued functions which are analytic 
on V. 

hemnta 6.2 , (Halkin-Hendrieks) . Let H: [a,b]. ->R P be a compact 
multifunction and suppose the graph of H is bounded. Let there 
exist a finite set of points s ± , i = 0,1,...,N such that 

a £ s o < '" S 1 • ' ' < - s p - p 0X1 ^- such that for each compact interval 

CT [a,b] which contains none of the points s. the -graph of 

* 

H restricted to [o:,[3] is semianalytic. Then / H - / K. 

Again this is only a slight extension of the main result 

(Theorem 2) in [H-6]. Indeed, the proof is clear upon examining the 

proof of that theorem. In effect one observes that / H D / H H) 

where $£?(/ H) denotes the set of extreme points of the convex set 

/ H, and that / H is convex, and then the proof is immediate. To 
* 

show that / H Dj^Xf H) one need only show that the function 
g. [a, o] -> H p is apwc, where g is defined by the condition that 
g(t) is the lexicographic maximum (with respect to an arbitrary 
orthonormal basis for R P as in Olech [0-1]) of H(.t), t.e [ a ,h]. 

If the s_^, i - 0,1, • ..,F and an interval [a,6]. are chosen as in 
the hypotheses of Lemma 6.2, then Halkin and Hendricks [H-6] have 
shorn g|[a,6] is pwc. Hence g : [a,t]eE P is apwc. 
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Lemma 6.3 (Halkin). Let Bl [a,b] x R^ -> R^ be a continuous func- 
tion with the property that there is a finite set of points 
s'., i = 0,1, such that a g s < s, < ... < s g b and .such’ 

that B| (a,S Q ) X R q , B| (s^b) x R q , and b| (s^^) X R 4 , i = 1,2,...,H 
are analytic. Define (%\ [a,b] x R^ -> by the relation 

j^(t,u) = (u,B(t,u)). Let Ql [a,b] -» R^ be a compact multifunction 
satisfying the generic hypotheses of Lemma 6.2, Then the compact 
multifunction [a,b] defined by $f(t) = _^(t,ft(t)), 

t e [a,b} also satisfies the generic hypotheses of Lemma 6.2, 

This result is a modification of a statement of Halkin'' s 
[H-5] • Since Halkin omitted a proof and since the above lemma 
differs somewhat from his result, we shall suggest a proof which is 
straightforward. There will be no loss in generality if we assume 
that the same points satisfy the hypothesis of Lemma 6.2 with 
Hi [a,b] -» R^ replaced by 0,° [a,b] R^. It will suffice for us 

to show that if [a,p] C [a,b] and £ . [a,6_], i = 0,1, 

then ^H'[g:,S 3] has a .sem'ianalytic graph. Let S? denote the graph 
of ^j.[o:,j3] and let P q = (^ 0 > u 0 .> x 0 ) 811 arbitrary point in 

R X R^ X R^ = R'^ fC ^ + \ Then there is a neighborhood V q of (t^u ) 
in R x R^ = R^” 1 ^ and analytic functions f.,g.., i = 1, . .„,k, 
j = ~L y . . . ; & on such that 

k n . -i 

E n V = U [(t,u) e K* |f (t,u) = 0 and g (t,u) > 0, 
i=l • ■ 

for j = 1, . . .jJi) 
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where E is the graph of f/j [a,p] . Let 23 denote the set 
{(tjU^x) e R P ri ' ( h ! '- 1 -| (t^-u) e V Q } > then 55 is a neighborhood of P q 
in A generic point (t^u^x) in r£ H c ^- + ' ! ' is also denoted 

by (fc 3 u^.,. ; ii^x^,,, r ^) and we write (B~,...,B^) for the 
function B. Let ir'. r^ 0 ^ - -» R^ 1 be defined by ir(t,u,x) - (t_,u). 
Define factions f. and g. . on 23 by the equations 

f (t,u,x) = [f (ir(t,u,x))] 2 + Z [B n (t,u) - x n ] 2 

n=l 

iyCW) = g ± /(lT (t^U^x)) 

for i = j = Then we have that there are real 

numbers 5,P such that (a ; j3) D [<x,P] and such that B is analytic 
,on (a,P) X P/E One can now verify that 

& n 25 n ((5,P) x R m ) = U ((t,u,x) € R^^If.CV^i) = 0 and 

i=l 

g. . (t,u,x) > 0 for j = l^j.,,^} 

where the functions f . and g. . are analytic on 9S n 

1 ij 

((c^p) X R-^^-). We can assume P Q e (a,P) X R^ 1 "^ since the contrary 
case can he dealt with trivialty. Thus is semianalytic and 

this proves the lemma. 

We now turn our attention to the control system (5.1). Let 

■X* 

denote the collection of all points in which 

are attainable from admissible triples '{cp,u,t} where 
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cp*. [-TjQ] ->-R n and uS [0,t] -> R m are apwc. Let J3^_($jU) denote 
the collection of all points in _Q^_($ J ,U) which are attainable from 
admissible triples {cp,u,t) where both cp and u are pwc. The 
variation of parameters formula* (2.7) when applied to the FHE (5.1) 
gives 

t o 

(6.1) x(t,<p,u) - q>(0)Y(0,t) + / h(u(of),a)Y(a,t)da+ / <p(a) (a,t)da 

O _T 

where $(ayt) is defined by the equation 

k 

^(«jt) = Z A i (o»-0 i )Y(c«-0 i ,t)x^_ 0 . ^j(a) 

J 1 i 

Ctf-T 

+ / A(s ; a-s)Y(s,t)ds, -t g a ^ 0. 
o 

Let a function 3ft I [-t, 0] X R n R 2n be defined by 

2R(a,<P') = (<p,<p ft (a,t)), -t g a s O', cp e R n , 

and let $Q°. [0,.t] x R m -» R^ 11 be the function defined by 
£>(u,a) = (u,h(u,a)Y(a,t)), 0 ^ a ^ t ; u e R m . 


* - 

We remark that the representation theorems can easily be shown to 

be valid under the analytic ity hypotheses placed on (5.1) in 
section 5 (Theorems 5*1* 5.2)'. 
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Define projections 7^’ R™ “ -> R' 1 and ir^'. R ?rL — > R n by the 


equations 


n m-s-n 


ir^(u,x) = Xj (u,x) e R ul x R • = R 

7r„(<p,x) = x_, (cp.x) e s n x R n - if U 


In each of the following three formulas the first integral on the 
right hand side of the equation is over the interval [0,t] and 
the second integral is. over the interval [ -t^O] . Using (6.1)' it 
can be shown that 


(6.2) J3^(®,U) = ®(0)T(0,t) + irj/ $(u(a),a)aa-3. + tt 2 [j gj?(a,®(a))daL 

•K- * 

-C/^(®^U) = ®(0)Y(a/o) + 7r 1 [/ &(u(a).a)da] + ir 2 [J <ro(a,®(cs))aa], 

* 

and 

sgfet u) = $ (o)Y(o.t) + 7T 1 [/ $(u(ct),a)da] + ir 2 [/SK(a,®(Q^)cia], 

whenever the left hand sides are nonempty. 

Theorem 6.1 . Let the homogeneous part of (5.1) satisfy the hypotheses 
of Theorem 5-2., and let the functions h(R m x [0, t ] * t a 0 satisfy 
the same conditions as the function B in Lemma 6.5. Let $1 [-TyO] 

— > R ' and U. [0/-°) -» R be compact, multifunctions satisfying the 

•X* “ T "- 

Here £ denotes the sub integral in Halkin and Hendricks [H-6], i.e., 

if HI [a.b] —i Jp is some multifunction, then f H = 
b - ' ; “ 

(/ g(t)dtjgl [a.b] — > R P is pwc and g(b) e H(t), for t e [a,h]). 
a 
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generic hypotheses of Lemma 6.2. Then 

-Q^(*,U) t & 0. 


Proof , With the aid of Theorem 5.2 and a few .rudimentary deductions, 
one can show that the function [O^t] x R m ~> p 1TH " n and the multi- 

function U" [ 0_, t ] — > R “ satisfy the generic hypotheses of Lemma b.3_, 
and similarly for the function SOc I 0] x R n — > R^ n and the 
multifunction §1 [-r^O] — >R n . Thus Lemmas 6.5 and 6.2 and the 
second formula in relation (6.2) apply to give the derived conclusion. 

Theor e m 6.2 . Let the homogeneous part of (5-1) satisfy the hypotheses 
of Theorem 5.1 and let the function h be analytic on ST* X [0,oo). 

Let [-TjO] -v R n and Ul [ 0 ,<») R 21 be compact molt if unctions 

such that the graph of § and the graph of uj [Opt] 'for t a 0 
are bounded and semianalytic. Then 


ja£(*,u) - jag.($,u)* t & o. 

With the aid of Theorem 5.1 and the above remarks the proof 
of this theorem will be so similar tc Haltin' s proof [H-5] of the 
corresponding result for nondelay systems that It can safely be 
omitted. 

Recalling Remark 3.5 one sees that Theorems 6.1 and 6.2 give 
new existence theorems for certain optimal control problems in the 



class of apvc admissible triples t] and the class of pwc 

admissible triples [cp^u^t] respectively. 
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